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Abstract 

A loglinear IRT model is proposed that relates 
polytomously scored item responses to a multidimensional 
latent space. Each item may have a different response 
function where each item response may be explained by one or 
more latent traits. Item response functions may follow a 
partial credit model (Andrich, 1^78; Masters, 1982) a 
multidimensional Rasch model (Rasch, 1961; Andersen, 1973, 
1983) or other Jorms of response functions to be defined by 
the user. Conditional maximum likelihood estimates are 
derived and the models may be tested generally or against 
alternative loglinear models. The latter tests are sensitive 
to deviations from local independence subgroup invariance or 
assumptions about the form of the operating characteristic 
curves . 

Key words: Multidimensional item response theory, Loglinear 
model, polytomous responses, graded response 
models, goodness of fit testing. 
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Loglinear Multidimensional IRT models 
for Polytomously Scored Items 

Loglinear models have been used for the estimation and 
testing of IRT models (Cressie and Holland, 1983; Duncan, 
1984; Kelderman, 1984; Tjur, 1982). They have proved useful 
in the solution of practical psychometric problems such as 
item bias detect ion (Kelderman , 198 5 ) and equating 
(Kelderman, 1986).. All loglinear IRT models considered so far 
are dealing with a one dimensional latent trait and 
dichotomously scored items. In many testing situations, 
however, different subjects may give responses that differ in 
psychologically treaningf ul ways . To produce one answer may 
require quite another ability from the examinee than to 
produce another answer. And even if both responses are 
related to the same latent trait, one response may be more 
difficult to give than another or one response may require 
the repeated application of the same ability whereas smother 
response may require only a single application of that 
ability. 

In the present paper, a loglinear IRT model is proposed 
that applies to the situation of polytomously scored test 
items that may be explained by a multidimensional latent 
space. The flexibility and generality of loglinear IRT 
modeling enables the analyst to formulate a model that is 
precisely tailored to the particular items in the test. In 
the proposed model each item may have a different number of 
response categories each of which may be related in a 
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different way to the latent traits. Item response functions 
may be specified according to a multidimensional Rasch model 
(Rasch, 1961; Andersen, 1973, 1983) or to a graded response 
model (Andrich, 1978 ; Masters , 1982) or another response 
function to be defined by the user. The usual assumption of 
local independence of the item responses given the latent 
traits is made. The parameters are estimated by the 
conditional maximum likelihood method and the models are 
tested either generally or against special alternative models 
that contain parameters describing deviations of local 
independence, subgroup invariance and the specified operating 
characteristic curves. 



The Model 



Suppose that each of N subjects respond to k test items 
where the answers of subject i to item j may be any of r^+1 
responses C x ij=°» • • » r j ) • The response pattern of subject 
i on all k test items is denoted by the vector x^ = (x^, 
Xi2'---» x ik- The corresponding random variables are denoted 
by capital letters Xj^ and X i# Let 0iq be a value of subject 

i on a latent ability continuum q=l s and let 8^ = 

< 9 il, 9 i2, • • • ' 9 is> *> e the vector of ability values. 

To produce a score x^-j on item j, subject i must perform 
certain operations where each operation depends on a certain 
proficiency on a latent trait. For example to produce a 
correct answer on the item "What is the square root of 
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fifteen minus six?", involves three operations. First, the 
; * expression V(15-6) must be obtained from the verbal 

formulation. Second, the subject must make the subtraction 
15-6=9. And finally, the square root V9=3 must be taken. It 
X may be hypothesized that to perform the first operation 

successfully, the subject must have a certain level on a 
\ verbal ability trait G^, and to perform the second and the 

\ third operation, a latent numerical ability 8^2 is needed. 

Producing tho correct answer '3' requires ability once 
and abi 1 ity 6^2 twice . Producing the part ial ly correct 
response '9' requires ability 6^1 and 6^2 each once. 
Producing the formula '/(15-6)' requires only 6^1 . 
t Let Bjq(x) be the number of times that a person has to 

apply latent trait q to produce a response x on item j and 
let <|>j(x) be a parameter describing the easiness of response 
\ x of item j. The probability that subject i has a response x 

on item j can now be written as : 



s 

exp{ E 6 iq Bjq(x) + <|>j(x)} 

(1) P(X ij= x) = — 

E J exp{ E 6 ia B ia (y) + ^^(y)} 
y=0 q=l 4 J4 J 



By choosing the functions Bj q ( . ) , different models can 
be chosen for the dependence of item responses on latent 

traits. In the sequel, the function Bj q (x) for x=0 rj 

and q=l s will be called the item scoring function (ISF) 

of item j . 
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Figure 1. gives some examples of item scoring functions 
that might be employed in model (1). In figure 2 each of 
these ISF's are showed in a diagram, where a latent variable 
is depicted in a circular box and an observed response in a 
square box. An arrow is drawn from a latent trait to an item 
response if that response depends on the latent trait. The 
value next to the arrow denotes corresponding value of 
B jq (x). 

ISF (a) describes the dichotomous Rasch model. A wrong 
response (x=0) is scored Bji(0)=0 and a correct response 
(x=l) is scored Bj^(l)=l indicating that a successful 
application of trait 1 is required. It is easily shown that 
with ISF (a) model (1) reduces to the dichotomous Rasch model 
(see Appendix I) 

In ISF (b) three responses are scored where response x=0 
corresponds to a wrong response and the responses x=l and x=2 
are both right responses involving one successful application 
of the latent trait. Both responses, however, may not be 
equally likely as the parameters <t>jd) and <()j(2) may differ. 

ISF (c) describes the partial credit model (Andrich, 
1978; Masters, 1982)(see Appendix II). The response x=2 has 
the score 2 indicating that the latent trait has to be 
applied twice to obtain the correct answer. The response x=l 
corresponds to a partial answer, for which the latent trait 
has to be applied only once. 

In ISF (d) through (h) two latent traits are involved. 
In ISF (d) the response x=l and x=2 each depend on a 
different latent trait. This is the multidimensional Rasch 
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model described by Rasch (1961) and Andersen (1973) (see 
Appendix III). In ISF (e) each response depends on its own 
latent trait but the item scores are not all equal to one. 
This model corresponds to Andersen's (1983) generalized Rasch 
model. 

ISF ( f ) describes a multidimensional partial credit 
model where each operation depends on a different latent 
trait. The correct response x=2 requires two operations 
depending on latent trait 6^1 and 6^2 respectively. The 
partial response x=l requires only one operation depending on 
the latent trait This might be an alternative ISF for 

the item V(15-6) where the first latent ability is 
subtraction and the second latent trait is taking the square 
root . 

Obviously a combination of (c) and (f), where there are 
different latent traits but some operations depend on the 
same latent trait, is also possible. ISF (g) , for example, 
may model the item V( 20-5-6) where there are two subtractions 
and one square root. 

ISF (h) is a two dimensional model for a dichotomous 
item. Finally, ISF (i) is the null function. The variable 
does not measure an underlying latent trait . This ISF may be 
used to add background variables (e.g. sex) to the model . 
Adding background variables may be useful to study subgroup 
imparlance of the psychometric model. This will be discussed 
in the section on goodness-of-f it testing. 

We have discussed some examples of ISF's. There may be 
many more ISF's than are shown here that make sense in a 
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particular application. Also in one test each item may have 
its own ISP. 



Estimation 

Assuming local independence, the simultaneous distribution of 
Xi = (X n X ik ) given 0i is 



k 

(2) P(Xi = XilOi) = n _ P(X = x I 6i) 

3 1 



exp {I 9.t. +2 ♦ (x )> . n c-l(9 ) 
q=l ic * ic ? j=l 3 ^ 3=1 1 3 



where <(>j = (<t»j(0) ^j(rj)) 



r.* s 

Oi. <t>i) = I exp{£ 9, B 4 (y) + * <y)} 
J y=0 q=l ic ? 3q 3 



and 



tiq=I B 3q <x 13 ) 



q = 1 s 



Note that (2) is an exponential family model and the 

sums of scores t^ t^ s are sufficient statistics for 

the latent ability parameters Q± s . That is, all 
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information about those latent ability parameters is 
contained in the sums of scores . The simultaneous 
distribution of the sum sc e variables taking values t± = 
(t^j, . . . t^ s ) is 

(3) f(t |6 ) = 1 f(s.|9.) = 

s k • 

y(ti. <t» . expiT. e ia ti q ) n c-l(e i( $a) 

q=l H 3=1 3 

with 

k 

(4) y(ti, <fr) = I exp{Z <M*ij)>- 

where <(>= (<t>i ^) and where E x j t means summation over 

those values of x ± for which (1^ B^Cx^ ^J^s^i^ is 

equal to t±. The conditional distribution of Xj^ 

given t^ t is is 

(5) P(Xi = Xi|t ± ) = P(X ± = XilGi) / fCtilGi) 

k 

= exp {£ <t>. (x )) / Y(ti, <t». 
3=1 3 

which does no longer depend on 

If it is assumed that individuals respond independently 
cf one another.* model (5) describes a multinomial 
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distribution of the response patterns x for each score 
pattern t, where the subject index i is dropped. 
Let 

(6) m xt = N t P(X=x|t) 



xj = 0 rj ; . . . ; x^ = 0 r^; x = (x^ x^) 

k k 

ti = I B. . (x. );...; t = I B. <x. ) ; t = <t. t ) 

1 j=l 31 3 s j =1 js 3 1 s 

be the conditional expected frequency of the response pattern 
x given score vector t and let f xt be the corresponding 
observed frequency. Taking logarithms we have the loglinear 
model : 



k 

(7) log mx t = a t + I ♦j (x j )- 



where a t = -log(y(t, <|>)/Nt) is a fixed normalizing constant 

and the parameters <fr-j( x -j) <3 = 1 k J x j = 0 T ^ 

are considered random parameters . 

Model (7) is a quasi-loglinear model for an incomplete 
item 1 x item 2 x ... x item k x score 1 x . . . x score s 
contingency table. The table is incomplete because the cells 
for which t q * Biq(xi) + B2q(x2) + ... + Bkq(xk) are 
structurally zero (Bishop. Fienberg and Holland, 1975; see 
5.4; Haberman, 1979, see 7.3). 

Unless further restrictions will be set on the 0 
parameters they will not be identifiable. To formulate 
identif lability conditions for model (7) first rewrite it as 
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** 

1 
?■ 


(8) log m t = a t + Dt<fr. 




1 

F 


where log is an element-wise operator aud m^ is the vector 




j- 

f 


of expected counts with sumscores t ,<(>=(<{> ^(0) , . .. fl 0^(r^) f 






.... ^(0), .... ^^(r^)) and D t is the design matrix with 






zero's and ones in the appropriate places. The identif la- 




$ ^ 


bility criteria are then (Imrey, Koch and Stores, 1981) 


i- 




(9) rank [1 D t ] = 1 + rank [D t ] 


\ 


f 


and 


S 

i 


1- 


(10) rank [D] = a 






where D* = [D'g. .... D 'tnjax^ a is the number of columns 




? 

4 


of D, i.e. the number of parameters. 




Condition (10) ensures that the <J> parameters are not 


< 




linearly dependent upon each other and condition (9) ensures 
they are not linearly dependent on the sumscore parameters. 

If D does not satisfy these identif lability conditions 
certain columns must be removed, which is equivalent to 




\ / 


setting the corresponding 0 parameters to zero. To derive the 




K 

K 


likelihood equations, it is assumed that the identif lability 




conditions are met. 

The conditional likelihood of model (7) is 




feERJC 




I 




t'i^vA'*- "v^v^-v. - ...... . 
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(11) L c = log n t ri x | t t( Ntl P(X = x|t) fjtt ) / fxtU) 

k 

= Z t Sxlt ( f d ^(x^) -y(t. <(») + constant 

1 « jsl J J 

k X-t 
= Z <t> (xj) f - Z N y(t. <(») + constant. 
j=l 1 x i z t 

where f x J is the marginal observed frequency of response x-j 
on item j. 

Model (11) is an exponential family model with 
x 1 

sufficient statistics f x J . Maximum likelihood equations can 
be obtained by talcing the derivatives of the loglikelihood 
for $ and setting them to zero. This yields the equations 
(Andersen. 1980; Haberman, 1975) 

(12) f = m J . x* = 0 ta; j = 1 k. 

T 

f = N . V t . 

t t 



Solving (12) for the parameters 4j(*j> yields maximum 
likelihood estimates of the parameters. 

The system (12) can be solved iteratively by a Newton 
Raphson Algorithm (Adbey and Dempster, 1974) or iterative 
proportional fitting (IPF) (Goodman, 1968 ; Bishop et all . 
1975 , p. 189) . Kelderman (1987) uses a version of IPF that 
does not require to internal storage of the full table of 
observed and expected counts and use's a special algorithm 
that considerably reduces the amount of computation to obtain 
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expected marginal tables. The method is implemented in the 
LOGIMO (Loglinear IRT modeling) program. 

Standard errors for the parameter estimates can be 
obtained by taking the inverse of the Fischer information 
matrix I which has elements 



d 2 log L c 

(13) 



d <t>j(x) d ^(y) 

j a 1 k; 1 a 1 k; x = 0 r -j ; y s 1 rj/ 

where j ^ 1 or x * y. 

The Fischer information matrix I provides a practical 
(ucihod of checking the identif iability of the model. A 
po^ibly indeterminate solution can be obtained via the IPF 
algorithm, since IPF does not require the model to be. of full 
rank. This solution can be used to calculate the information 
matrix I. If I is not of full rank, rows (and columns) that 
are linearly dependent on the preceding columns may be 
successively deleted from the matrix I until a full rank 
matrix is obtained. The parameters corresponding to the 
deleted columns are not identifiable and they are removed 
from the model by setting them to zero. 



Testing 



The overall goodness of fit of model (1) can be tested 
by the Pearson statistic 
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Is 


U4, !> - X <f " ' 
x m xt 


) 


I 


or the likelihood ratio statistic 




t ' 


(15) G2 = -2 2 f xt lnCn^ / f xt ). 






Both statistics are asymptotically distributed as chi- 






square with degrees of freedom equal to the difference 




% 


between the number of logically nonzero cells and the number 


- I 


? 


of estimable parameters. If any of the expected counts become 


! 


!- < ■ 


to small, however, the approximation of the distribution of 


< 


?- 
s 


X 2 and G 2 by a chi-square distribution becomes inappropriate 


l 


v- 


(Lancaster, 1961; Koehler, 1977, 1986; Larnz, 1978). Although 




1^ * 


the distribution of X 2 is generally closer to chi-square than 


I 




G 2 (Cox and Plackett, 1980; Larnz, 1978). The traditional 


■f 


f 

/■ - 


criterion for the size of tho expected counts is five but if 
the distribution is smooth the minimum expected count could 
be as small as one (Cochran, 1952). 

This, however, would still mean that the overall 


\ 
\ 




statistics (14) and (15) are only useful with small numbers 






of items. Suppose for example we have ten trichotomous items. 






We would have 59049 non logically-zero counts. 

If the number of items is large, we choose to test the 
model against specific alternative loglinear models that 




1 


contain model (7) as a special case and also contain 




jf 


parameters describing a particular deviation. Let m* xt denote 


- 


i 

£ 

5 

X 
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i the expected counts under a particular alternative model. The 

t likelihood ratio test statistic is then 

I (16) G 2 (m,m*) = -2(L C -L* C ) 

I and is asymptotically distributed as chi-square with degrees 

if of freedom equal to difference in numbers of estimable 

>*** 

I parameters of both models. Any loglinear model (8) that 

}> arises by extending the design matrix D with columns and 

r extending the parameter vector $ with parameters might be 

\ 

r chosen as alternative model, provided that the 

identifiability conditions (9) and (10) are met. 

I Three types of alternative models may be used, models 

t that are sensitive to deviations from the operating 

r characteristic curves, models that are sensitive to 

V violations of the local independence assumption and models 

f- that are sensitive to deviation of subgroup invariance. 

I In the first type of the model, parameters describing an 

l interaction between one or more sum scores tq and an item 
response x-j may be added to model (7). For example, the model 

? k 

; (17) Log mx t = a t + I *j(xj) + <t> q j(t q xj) 

contains a model term <t>qj(tqxj) describing the interaction of 

j- the score tq and item response Xj comparing (17) against (7) 

I; using the likelihood-ratio test (16) yields a test for ',he 

\z 

I? hypothesis that this term is different from zero. It means 
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that the operating characteristic curve of this item with 
respect to latent trait q deviates from that expected by the 
model . If one wants to look only at the operating 
characteristic of one answer category, say y, the parameter 
may be set to zero for all other item responses xj * y t the 
model 



(18) 



log m^ = a t + 2 <M*l> + ♦ ..(x.x.) 

j=l J J jl j 1 



may be compared with model (7). The parameter <t>ji(Xj*i) 
describes an interaction between both items that cannot be 
explained by the original model. Terms describing the 
interactions between other item pairs of items and terms 
describing triplets of items may be added to the models. 

If xj is not an item but a subgroup variable the term 
(^(XjX^) in model (18) describes deviations from subgroup 
invariance of item 1. In that case the item scoring function 
of item Xj must be the null function (see Figure l(i)). If 

^jl^ x j x l^ is not zer0 ' the Parameters differ from subgroup to 
subgroup. These subgroup-dependent item parameters may be 
used to study item bias with respect to, for example, ethnic 
group or sex. 

Like the loglinear IRT-model alternative loglinear 
models may be estimated by solving likelihood equations of 
the form (12) where again the sufficient statistics of the 
extra parameters are set equal to their expectations, in 
terms of the parameters. 
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x Likelihood-ratio tests can be used to compare the fit of 

t two models if one model is nested within another model. If 

i ' 

i' two models are not nested, Akaike's (1977) information 

I criterion is used: 

I AIC s G 2 + 2 '# of parameters) + C, 

d 

| where C is a constant that is the same for all models fitted 

h to the same data. The model with the smallest AIC (or AIOC) 

I is chosen as the best fitting model. 

£ - 

An Example 

I Van Kuyk (1988) developed a test to identify learning 

problems in children from four to six— and— a-half years old. 
I The tests measures the application of antonimic dimensional 

I size concepts such as long-short, high— low, thick-thin (see 

? Figure 3). Fifteen items are administered to 66 children of 

: * age 4 to 5, 132 children of age 5 to 5.5, and 65 children of 

5.5 to 6 years old. 
I The figures were shown and pointed at by the test 

I administrator, while (s)he said "here you see some shirts, 

they gradually become a bit ... (shorter)", the answer was 
rated correct if the right size concept (e.g. long-short) was 
given and was correctly applied (e.g. shorter rather than 
longer) . Small children may be unable to produce the correct 
specific concept (e.g. long-short) but use the general size 
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concept 'big-small' instead. If 'big-small' is correctly 
applied (e.g. the shirt is smaller) the answer is rated 
partially correct. All other answers are rated incorrect. 

Three ISF are applied to this data: the one dimensional 
partial credit model (IPC. Figure 1c), the two dimensional 
partial credit model (2PC. Figure If) and the two dimensional 
Rasch model (2RH. Figure Id). In the IPC it is hypothesized 
that one spatial ability has to be applied twice to obtain 
the correct answer: once to know the eztensiveness of the 
objects (e.g. small or large) and once to identify the 
correct dimension (e.g. short-long). 

In the 2PC model both processes are supposed to depend 
on distinct abilities, an eztensiveness ability and a 
specific concept ability. To produce the correct answer both 
abilities have to be applied once. To produce the partially 
correct answer (small) only the first ability is needed. 

Finally in the 2RM model two latent abilities are 
conjectured: a general eztensiveness and a specific 
eztensiveness ability. The general eztensiveness ability is 
applied to get the partially correct answer and the specific 
eztensiveness ability is sufficient to produce the correct 
answer. The difference between the 2PC and the 2RM model is 
that 2RM does not require an application of a general 
eztensiveness ability to produce the correct answer but the 
2PC does. 

For all three ISF's two models are fitted: model (7) 
where the item response parameters are invariant over 
subgroups : 



22 
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(19) log m xt = C t + ^i(xi) + ... + 4>is(xis) + $!6<xi6) 

with constraints <frj(0) = 0, j = 1 16, and model (18), 

where the item response parameter vary from subgroup to 
subgroup: 

(20) log o^t = a t + 4>i(xi) + ... + 4>i5(xis) + 4>i6(xi6) 

+ 4>1.16(*1*16) + ... + 4>15.16<X15.X16) 

with constraints <frj(0) = 0, j = 1 16 and 4>j , 16<°' X 16) = 

♦j # 16(xj.l) = 0, j = 1 15. Thus the parameters are 

normed such that 4>j(xj) (j = 1 15) are the item 

response parameters in the youngest age group (x^-l) and the 
<|>j # 16(xjxi6) are deviations of those parameters for older age 
groups . 

Table 1 presents the test results of the six models. It 
is seen that the subgroup dependent versions of the models 
have a significantly better fit than the subgroup invariant 
versions. The likelihood-chi-square statistics are all very 
large relative to the degrees of freedom. 

Since the IPC, 2PC and 2RM models are not nested their 
fit is compared with Akaike's information criterion. The AIC 
values are given plus a constant to produce a relative small 
number. The best fitting model according to the AIC criterion 
is the 2RM model closely followed by the 2PC model. 
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The maximum likelihood estimates of the age dependent 
2PC model are given in Table 2. The 2RM model shows a similar 
picture. It is seen that the easiness of the partial response 
ard the correct response changes positively for some items 
and negatively for other items. For example item 13, showing 
bags with different amounts of candy, becomes relatively more 
easy as children get older. 
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APPENDIX I: The Dic hotomous Rasch Model. 

Using ISF a (Figure 1) with Model (1) we obtain: 



Pj(*ij-l|»i) = 



exp{9i + «j(D) 



expOjO+fjCO)) + expOi+^d)) 

exp{9i - 8j) 

= j 

1 + exp{8j- 8j) 

where 8j = ($j(0) - <frj(D). This is identical to the 
dichotomous Rasch model. 



3 
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APPENDIX II: The Partial Credit Model . 

Since there Is only one latent trait, the subscripts q 
are omitted. With ISF (c) model 1 becomes 



exp{8jX + <tu(x)) 
PjCXi^xlOi) = J 



I J exp^y + <t)-j(y)) 
y=0 



Dividing numerator and denominator by exp{<|>j(0)} and writing 
Vj(x) = (<t>j(x) -<()j(0)) we obtain: 



exp{9 i x + \|f4(x)) 
PjCXi^xlOi) = 3 



I ^ exp{9iy + Vj(y)} 



exp{I^ 

1 + expit! (9^!)} 

y=l 1=1 J 



where 



x x-1 
5 jx = £ 1=1 8jl - 2 8jl = -(VjCx) - Vj(x-l)) 



which is the Masters (1982) model. 
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APPENDIX III: Rasch's (1961) Multidimensional Model 
Using ISF (d) (Figure. 1) in (1) y.ields 



exp {0i D + ^i(p)) 

p(x i;J =p|e i ) = ip 3 



2 ^ exp{9 ig + ♦j(p)) 



exp {©ip- 8jp) 



r i 

£ exp{9 ig - Sjg) 



with = 0. where 6j p = -^j(p). which is equivalent ' to 
Andersen's (1973) Rasch model for polytomous responses. 
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table 1 



good n ess of Fit Stat i s t i cs for Si x Mo dels on th* tt,i Y v n fl rn 



96' t 



ItOffl 



Subgroup Invariant Par am. 



Subgroup Dependent Par am. 



Difference 



faction 


LR 


# of par am. 


AIC-C 


LR 


# of par am. 


AIC-C 


LR 




DF 


p-value 


IPC 


3436. 


51 


108 


652.51 


3280 


.01 


165 


610.01 


156 


50 


57 


.00 


lie 


3298. 


51 


152 


602.51 


3141 


92 


209 


559.92 


156 


59 


57 


.00 


fP 


3291. 


86 


156 


603.86 


3132 


94 


213 


558.94 


158. 


92 


57 


.00 
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f Table 2 

| Parameter Estimates of the Age Dependent Two Dimensional 

I; Partial Cred it Model (2VC) 



Response Effect Response X Age Effect 



Partial Response Correct Response 







Part.R. 


Corr.R. 


4-5 


5-5.5 


5.5-6 


4-5 


5-5.5 


5.5-6 




l 


0.85 


2.39 




0.52 


0.17 




1.36 


0.10 




2 


1.00 


-1.00 




-0.94 


-1.50 




-0.43 


-1.14 




3 


2.35 


2.78 




0.21 


0.26 




1.00 


-0.00 




4 


0.58 


2.77 




-0.96 


0.42 




-0.90 


-0.03 




5 


2.36 


3.42 




-1.51 


-2.19 




-0.83 


-0.54 


I - 


6 


-0.41 


-0.27 




1.25 


2.30 




0.17 


1.39 




7 


-0.96 


-2.15 




1.35 


1.82 




1.80 


2.75 




8 


-1.76 


-0.43 




-1.72 


0.49 




0.57 


1.32 




9 


-0.42 


0.47 




1.25 


2.10 




1.06 


2.82 




10 


0.63 


-1.09 




1.36 


2.60 




1.52 


2.77 




11 


1.02 


1.47 




0.82 


0.11 




1.03 


0.25 




12 


0.77 


1.95 




1.27 


1.88 




1.26 


2.20 




13 


1.18 


-1.69 




1.70 


2.53 




2.96 


4.86 




14 


0.16 


1.53 




0.64 


0.52 




0.92 


1.27 




15 


2.42 


-0.19 




1.24 


0.91 




0.87 


1.47 



Figure Caption 
Figure 1. Examples of item scoring functions. 
Figure 2 . Diagrams for the item scoring functions in Figure 1 
Figure 3 . An item from Kuyk's size concept test. 
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